Information providing method

ABSTRACT

An information providing method includes: generating first information indicating that a user who is interested in first content is relaxing, when (i) a current behavior of the user includes a predefined behavior and (ii) the first content included in information on communication content and second content included in information indicating a shopping history are the same content; obtaining, from a second information processing apparatus connected to a first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputting, to the second information processing apparatus, second information including information for identifying the user or a space, using the generated first information.

CROSS REFERENCE TO RELATED APPLICATIONS

This is a continuation application of PCT International Application No. PCT/JP2019/038863 filed on Oct. 2, 2019, designating the United States of America, which is based on and claims priority of U.S. Provisional Patent Application No. 62/740,036 filed on Oct. 2, 2018, U.S. Provisional Patent Application No. 62/740,061 filed on Oct. 2, 2018, U.S. Provisional Patent Application No. 62/740,076 filed on Oct. 2, 2018, U.S. Provisional Patent Application No. 62/740,086 filed on Oct. 2, 2018, U.S. Provisional Patent Application No. 62/740,132 filed on Oct. 2, 2018, U.S. Provisional Patent Application No. 62/754,057 filed on Nov. 1, 2018, U.S. Provisional Patent Application No. 62/754,060 filed on Nov. 1, 2018, U.S. Provisional Patent Application No. 62/754,063 filed on Nov. 1, 2018, and U.S. Provisional Patent Application No. 62/754,065 filed on Nov. 1, 2018. The entire disclosures of the above-identified applications, including the specifications, drawings, and claims are incorporated herein by reference in their entirety.

FIELD

The present disclosure relates to an information providing method.

BACKGROUND

In recent years it has become possible to collect a large amount of sensor data from sensors placed in various places, and thus there is a demand to effectively use the collected sensor data. For example, if sensor data from various sensors placed in an indoor space such as a house is used, it is possible to provide services suitable to the user's situation (for example, see Japanese Patent Application Publication No. 2018-32272).

SUMMARY Technical Problem

However, with the conventional art, there is little information that is related to how to use the sensor data, and it is therefore difficult to effectively use the sensor data for providing services.

The present disclosure provides, for example, an information providing method that can effectively use sensor data for providing services.

Solutions to Problem

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A sensor is disposed in a space. The processor: obtains, via the sensor, a current behavior of a user; obtains, from the memory, information indicating a predefined behavior predefined as a relaxation behavior; obtains, from the memory, information on communication content of a communication tool; obtains, from the memory, information indicating a shopping history of the user; when (i) the current behavior of the user includes the predefined behavior and (ii) first content included in the information on the communication content and second content included in the information indicating the shopping history are a same content, generates first information indicating that the user who is interested in the first content is relaxing; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A first sensor and a second sensor are disposed in a space, the second sensor being a temperature sensor. The processor: obtains, via the second sensor, a current temperature of the space; obtains, from the memory, a past statistical temperature of the space; obtains, via the first sensor, a current activity of a user; when (iii) the current temperature is lower than the past statistical temperature by a threshold temperature or more and (iv) the current activity of the user includes a predefined activity predefined as an activity of looking for clothes, generates first information indicating that the user feels cold; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A first sensor and a second sensor are disposed in a space, the second sensor being a temperature sensor. The processor: obtains, from the memory, a past ventilation history of the space based on sensor data from the second sensor; obtains weather information corresponding to a location of the space; obtains, from the memory, predefined weather predefined as weather suitable for ventilation; obtains, via the first sensor, air information indicating a pollution level of air in the space; when (v) a given amount of time or more has elapsed from a most recent date and time included in the past ventilation history of the space to a current date and time, (vi) the weather information indicates the predefined weather, and (vii) the pollution level of the air in the space is a given pollution level or higher, generates first information indicating that conditions are suitable for ventilating the space; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying a user or the space, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. An object and a sensor are disposed in a space. The processor: obtains, via the sensor, a degree of dirtiness of the object; obtains, from the memory, a past maintenance history of the object; when (viii) the degree of dirtiness of the object obtained is greater than a given degree of dirtiness and (ix) a given amount of time or more has elapsed from a most recent maintenance date and time included in the past maintenance history of the object to a current date and time, generates first information indicating that a time to perform maintenance of the object is approaching; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying a user or the space, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A first sensor and a first electronic device are disposed in a kitchen space of a home. A second sensor and a second electronic device are disposed in a dining space of the home. The processor: obtains, via the first sensor, current sensing information corresponding to the kitchen space; obtains, from the memory, past sensing statistical information corresponding to the dining space; when (x) the current sensing information includes information indicating at least one of a user being present in the kitchen space or the first electronic device in the kitchen space being active and (xi) an amount of time from a current time to a statistical time included in the past sensing statistical information is a given amount of time or less, generates first information indicating that a mealtime will soon begin in the dining space, the statistical time indicating at least one of the user being present in the dining space or the second electronic device in the dining space being active; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A washing machine and a sensor are disposed in a space. The processor: when (xii) a type of a stain on laundry to be washed in the washing machine is obtained by the sensor and (xiii) a washing mode suitable for the type of the stain on the laundry is selected from among washing modes of the washing machine, generates first information indicating that a user is about to wash the laundry using the washing machine; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A sensor and a cooking appliance are disposed in a space. The processor: obtains, via the sensor, current activity information of a user in the space; obtains current user-operation information of the cooking appliance; when (xiv) the activity information includes an activity of the user holding a given food or drink in hand and (xv) the current user-operation information includes a predefined user operation predefined as operation of the cooking appliance by the user for starting preparation of the given food or drink, generates first information indicating that the user is about to start preparing the given food or drink using the cooking appliance; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.

An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A sensor and an electronic device that outputs at least one of sound or video are disposed in a space. The processor: obtains device activity information of the electronic device; obtains, via the sensor, activity information of a user; when (xvi) the device activity information indicates that the electronic device is active and (xvii) the activity information indicates that the user is moving from the space to another space, generates first information indicating that the user is moving from the space to the another space while the electronic device is active; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.

General and specific aspect(s) disclosed above may be implemented using a system, an apparatus, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or any combination thereof.

Additional benefits and advantages of the disclosed embodiments will be apparent from the Specification and Drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the Specification and Drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.

Advantageous Effects

The information providing method according to one aspect of the present disclosure can effectively use sensor data for providing services.

BRIEF DESCRIPTION OF DRAWINGS

These and other advantages and features will become apparent from the following description thereof taken in conjunction with the accompanying Drawings, by way of non-limiting examples of embodiments disclosed herein.

FIG. 1 illustrates an overview of the service providing system according to Embodiment 1.

FIG. 2 illustrates the configuration of the service providing system according to Embodiment 1.

FIG. 3 illustrates the functional configurations of the first information processing apparatus and the second information processing apparatus according to Embodiment 1.

FIG. 4 is a sequence diagram for the service providing system according to Embodiment 1.

FIG. 5 is a flow chart illustrating processes performed by the first information processing apparatus according to Embodiment 1.

FIG. 6 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 1.

FIG. 7 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 2.

FIG. 8 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 3.

FIG. 9 illustrates one example of the past ventilation history of space 20 according to Embodiment 3.

FIG. 10 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 4.

FIG. 11 illustrates one example of the maintenance history of the object according to Embodiment 4.

FIG. 12 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 5.

FIG. 13 illustrates one example of past sensing information related to the activity of the second electronic device according to Embodiment 5.

FIG. 14 illustrates one example of past sensing information obtained by the motion sensor according to Embodiment 5.

FIG. 15 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 6.

FIG. 16 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 7.

FIG. 17 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 8.

FIG. 18 is a sequence diagram for the service providing system according to Variation 1.

FIG. 19 is a sequence diagram for the service providing system according to Variation 2.

FIG. 20 is a flow chart illustrating one example of the process for generating the second information according to Variation 3.

FIG. 21A illustrates one example of relationships between services and the five senses according to Variation 3.

FIG. 21B illustrates one example of relationships between devices and the five senses according to Variation 3.

FIG. 22 is a flow chart illustrating one example of the process for generating the second information according to Variation 4.

FIG. 23 illustrates one example of the service provision history according to Variation 4.

FIG. 24A illustrates one example of service provision availability information according to Variation 4.

FIG. 24B illustrates one example of information indicating services that are prohibited from being provided simultaneously according to Variation 4.

FIG. 24C illustrates one example of information indicating services that are prohibited from being changed according to Variation 4.

FIG. 25 is a flow chart illustrating one example of the process for outputting the second information according to Variation 5.

FIG. 26A illustrates an overview of the service providing system.

FIG. 26B illustrates one example of the data center operating company.

FIG. 26C illustrates one example of the data center operating company.

FIG. 27 illustrates service type 1 (in-company data center).

FIG. 28 illustrates service type 2 (IaaS).

FIG. 29 illustrates service type 3 (PaaS).

FIG. 30 illustrates service type 4 (SaaS).

DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments are specifically described with reference to the drawings.

Each of the following embodiments describes a general or specific example. The numerical values, shapes, materials, elements, the arrangement and connection of the elements, steps, order of the steps, etc., shown in the following embodiments are mere examples, and therefore do not limit the scope of the claims.

The figures are not necessarily precise illustrations. In the figures, elements that are essentially the same share like reference signs. Accordingly, duplicate description thereof is omitted or simplified.

Embodiment 1 Overview of Service Providing System 10

First, an overview of service providing system 10 will be described with reference to FIG. 1. FIG. 1 illustrates an overview of service providing system 10 according to Embodiment 1.

In service providing system 10 according to the present embodiment, sensor data from a plurality of indoor spaces is collected by a cloud server. Examples of an indoor space include a home, an office, a building, and the inside of a vehicle. Sensor data is data based on usual activity and/or unusual activity of a user in an indoor space.

Via an application programming interface (API), each of a plurality of service providers is capable of obtaining various information based on sensor data collected by the cloud server. An API is an information processing function of a cloud server that can be called from a computer and used.

Each service provider provides a service to a user based on information obtained via the API. Examples of services include an information providing service, an advertisement delivery service, a service for automated control of devices on a home network, or any combination thereof. Note that the service is not limited to these examples. For example, the service may be a product delivery service.

Configuration of Service Providing System 10

Next, the configuration of service providing system 10 will be described with reference to FIG. 2. FIG. 2 illustrates a configuration of service providing system 10 according to Embodiment 1. As illustrated in FIG. 2, service providing system 10 according to the present embodiment includes first information processing apparatus 100, second information processing apparatus 200, sensor group 300, and device group 400.

Sensor group 300 is disposed in space 20, and includes at least one sensor. Sensor group 300 is connected to a communications network such as the internet via gateway 500. Note that gateway 500 is optional; sensor group 300 may be connected to a communications network without passing through gateway 500.

Sensor group 300 outputs a sensor value indicating, for example, movement information related to a movement of a user or information related to activity/user operation of device group 400. For example, sensor group 300 can output a sensor value indicating whether a luminaire is emitting light, a sensor value indicating whether an audio device is outputting sound, a sensor value indicating whether a user is present in space 20 or a predefined region of space 20, or any combination thereof.

Sensor group 300 can include, for example, a motion sensor, a door sensor, a sound sensor, or any combination thereof. Such sensors included in sensor group 300 can be realized as, for example, an image sensor, an infrared sensor, an ultrasound sensor, a visible light sensor, a vibration sensor, a touch sensor, a microphone, or any combination thereof. Such sensors can be provided on a wall, floor, or ceiling that defines space 20, or on an electronic device or furniture disposed in space 20. Moreover, the sensors may be provided in devices included in device group 400. For example, one sensor may be a touch sensor provided in the touch screen of a smartphone or the like. Note that the sensors are not limited to the above examples.

Device group 400 is disposed in space 20, and includes at least one electronic device. Device group 400 is connected to a communications network such as the internet via gateway 500. Note that gateway 500 is optional; device group 400 may be connected to a communications network without passing through gateway 500.

Device group 400 can include, for example, a display panel, a luminaire, an audio device, a refrigerator, a vacuum cleaner, or any combination thereof. Note that the one or more devices included in device group 400 are not limited to these examples.

First information processing apparatus 100 is disposed outside of space 20 and includes a processor and memory. For example, first information processing apparatus 100 corresponds to the cloud server illustrated in FIG. 1. Note that first information processing apparatus 100 may be an edge server disposed in space 20.

Note that a cloud server refers to a server that is provided over the internet. An edge server refers to a server that is provided over a network in an area closer to the user than the internet is (such as a local area network (LAN)).

Second information processing apparatus 200 includes a processor and memory. For example, second information processing apparatus 200 is the service provider illustrated in FIG. 1. Second information processing apparatus 200 provides a service to a user via device group 400 in space 20.

This example assumes that service providing system 10 illustrated in FIG. 2 is provided in each of a plurality of indoor spaces. More specifically, first information processing apparatus 100 is provided for each of a plurality of indoor spaces, and a plurality of second information processing apparatuses 200 are connected to each first information processing apparatus 100 to provide services to each indoor space. Here, the aim is to provide of a variety of information regarding users or spaces 20 from the plurality of first information processing apparatuses 100, and to provide a variety of services using the plurality of second information processing apparatuses 200, by providing a plurality of first information processing apparatuses 100 and a plurality of second information processing apparatuses 200 individual of one another. However, new information is exchanged between the plurality of first information processing apparatuses 100 and the plurality of second information processing apparatuses 200. The present embodiment provides a system which effectively uses sensor data and provides appropriate services, by defining the exchange of such information.

Functional Configuration of First Information Processing Apparatus 100

Next, the functional configuration of first information processing apparatus 100 will be described with reference to FIG. 3. FIG. 3 illustrates the functional configurations of first information processing apparatus 100 and second information processing apparatus 200 according to Embodiment 1.

As illustrated in FIG. 3, first information processing apparatus 100 according to the present embodiment includes sensor data obtainer 101, first memory 103, determiner 104, second memory 105, first information generator 106, third memory 107, second information generator 108, and inputter/outputter 109. Next, the functional blocks of first information processing apparatus 100 will be described.

Sensor data obtainer 101 obtains first sensor data including a first sensor value from sensor group 300. Part or all of first sensor data is stored in first memory 103. First sensor data may include data indicating whether a person is present in a given region in space 20, for example. First sensor data may include data indicating a state of sound output of an audio device, for example. First sensor data may include data indicating an operation state of a device. First sensor data may include data indicating whether a door of a refrigerator is open or closed.

First memory 103 stores part or all of the first sensor data obtained by sensor data obtainer 101.

Determiner 104 determines whether a first condition is satisfied or not. The first condition will be described in greater detail later.

Second memory 105 stores information for generating the first information. For example, second memory 105 stores a correspondence table in which content of the generated information is associated with mutually different conditions.

First information generator 106 generates first information when the first condition is satisfied. In the present embodiment, the first information indicates that the user is interested in the first content, but the first information is not limited to this example.

Third memory 107 stores information for generating second information. In other words, third memory 107 stores information for identifying the user or space 20 corresponding to the first information generated by first information generator 106.

Second information generator 108 determines whether content of the first information is included in first request content included in information obtained from second information processing apparatus 200 via inputter/outputter 109. When content of the first information is included in the first request content, second information generator 108 generates the second information using the first information. The second information includes information for identifying the user or space 20 (for example, a user ID, a home address, an IP address, device identification information, etc.). For example, second information generator 108 generates the second information by reading, from third memory 107, information for identifying the user or space 20 corresponding to the first information generated by first information generator 106. Here, the second information may be information required for providing a service to the user or space 20. When content of the service to be provided is included in the first request, the second information corresponding to the content of the service may be provided. In a case in which the service is to be provided using a communications environment, one example of the second information is an IP address. In a case in which the service to be provided is for controlling a device, one example of the second information is device identification information. In a case in which the service to be provided is for controlling a device using a communications environment, one example of second information may be a combination of an IP address and device identification information.

Inputter/outputter 109 obtains information indicating the first request content (hereinafter “first request information”) from second information processing apparatus 200 connected to first information processing apparatus 100 over a network. Inputter/outputter 109 further outputs the second information generated by second information generator 108 to second information processing apparatus 200.

Note that determiner 104, first information generator 106, and second information generator 108 described above are realized as, for example, a processor and memory. When an instruction or a software program that is stored in the memory is executed, the processor functions as determiner 104, first information generator 106, and second information generator 108. Determiner 104, first information generator 106, and second information generator 108 may be realized as dedicated electronic circuitry.

First memory 103, second memory 105, and third memory 107 described above are realized as, for example, semiconductor memory and/or a disk drive or the like. Inputter/outputter 109 is realized as, for example, a network interface controller (NIC) or the like.

Functional Configuration of Second Information Processing Apparatus 200

Next, the functional configuration of second information processing apparatus 200 will be described with reference to FIG. 3.

As illustrated in FIG. 3, second information processing apparatus 200 according to the present embodiment includes fourth memory 201, request generator 202, inputter/outputter 203, fifth memory 204, service generator 205, and outputter 206. Next, the functional blocks of second information processing apparatus 200 will be described.

Fourth memory 201 stores information for generating the first request information.

Request generator 202 generates the first request information. More specifically, request generator 202 references information stored in fourth memory 201 to generate the first request information indicating the first request content.

The first request content indicates requirements that a user or space to which a given service is provided should meet. In the present embodiment, the first request content indicates a requirement that the user be interested in the first content, but the first request content is not limited to this example.

Inputter/outputter 203 outputs the first request information generated by request generator 202 to first information processing apparatus 100. Inputter/outputter 203 further obtains the second information from first information processing apparatus 100.

Fifth memory 204 stores information for generating service information. For example, fifth memory 204 stores a correspondence table in which service content is associated with mutually different request content.

Service generator 205 generates first service information using the second information. The first service information is information for providing a service to the user in space 20 via device group 400.

In the present embodiment, the first service information is, for example, control information for causing a display panel to display information related to the first content. For example, when the first content is foreign language learning, information on a café near space 20 at which foreign language conversation can be had is displayed on the display panel. Information related to video content suitable for foreign language learning may also be displayed. Note that the first service information is not limited to the above examples.

Note that “service information” may also be referred to as “service content”. Service content includes service information such as music or advertisement information, and device control information for providing the service.

Outputter 206 references the second information and outputs the service information generated by service generator 205 to device group 400. Note that second information processing apparatus 200 may include memory for recording the association between information corresponding to the second information and information required for providing the service, obtain information required for providing the service by referencing the second information, and provide the service to the user or space 20.

Request generator 202 and service generator 205 described above are realized as, for example, a processor and memory. When an instruction or a software program that is stored in the memory is executed, the processor functions as request generator 202 and service generator 205. Request generator 202 and service generator 205 may be realized as dedicated electronic circuitry.

Fourth memory 201 and fifth memory 204 described above are realized as, for example, semiconductor memory and/or a disk drive or the like. Inputter/outputter 203 and outputter 206 are realized as, for example, a network interface controller (NIC) or the like.

Interaction in Service Providing System 10

Next, interaction in service providing system 10 will be described with reference to FIG. 4. FIG. 4 is a sequence diagram for service providing system 10 according to Embodiment 1.

As illustrated in FIG. 4, first information processing apparatus 100 obtains the first sensor data including the first sensor value from sensor group 300 (S101). First information processing apparatus 100 determines whether the first condition is satisfied based on the first sensor data (S102). Stated differently, the obtainment of the first sensor data can be said to be trigger information for determining whether the first condition is satisfied. If the first condition is satisfied, first information processing apparatus 100 generates the first information (S103). The first sensor data that serves as the trigger information for determining whether the first condition is satisfied is used in the determining of whether the first condition is satisfied. In other words, in addition to being used as trigger information, the first sensor data can be used in the determining of whether the first condition is satisfied, which corresponds to a condition for providing a service. Moreover, first sensor data that served as trigger information for determining whether the first condition is satisfied in the past may be used in the determining whether the first condition is satisfied.

Here, if first information processing apparatus 100 obtains the first request information from second information processing apparatus 200 (S111), first information processing apparatus 100 determines whether there is a user or space that satisfies the first request content (S112). If first information processing apparatus 100 determines that there is a user or space that satisfies the first request content, first information processing apparatus 100 generates the second information (S113). First information processing apparatus 100 then outputs the generated second information to second information processing apparatus 200 (S114).

Second information processing apparatus 200 generates the first service information based on the second information (S121). The first service information is information for providing a first service to the user in space 20 via device group 400. Second information processing apparatus 200 then outputs the first service information to device group 400 (S122).

Note that the sequence diagram illustrated in FIG. 4 is a non-limiting example. Moreover, the order of the processes in FIG. 4 may be changed.

Processes Performed by First Information Processing Apparatus 100

Next, processes performed by first information processing apparatus 100 (i.e., the information providing method) will be described in greater detail with reference to FIG. 5. FIG. 5 is a flow chart illustrating processes performed by first information processing apparatus 100 according to Embodiment 1.

As illustrated in FIG. 5, sensor data obtainer 101 obtains the first sensor data including the first sensor value from sensor group 300 disposed in space 20 (S101). Determiner 104 determines whether the first condition is satisfied based on the first sensor data (S102). This determination process will be described in greater detail later with reference to the figures.

If the first condition is satisfied (Yes in S102), first information generator 106 generates the first information (S103). If the first condition is not satisfied (No in S102), first information generator 106 skips the process for generating the first information, that is to say, first information generator 106 does not generate the first information.

Next, inputter/outputter 109 obtains the first request information indicating the first request content from second information processing apparatus 200 (S111). Second information generator 108 determines whether there is a user or space that matches the first request content (S112). In other words, second information generator 108 determines whether the first request content includes the content of the first information or not.

When second information generator 108 determines that there is a user or space that matches the first request content (Yes in S112), second information generator 108 generates the second information using the generated first information (S113). Inputter/outputter 203 then outputs the generated second information to second information processing apparatus 200 (S114). When second information generator 108 determines that there is not a user or space that matches the first request content (No in S112), second information generator 108 skips the processes for generating and outputting the second information. In other words, second information generator 108 does not generate and output the second information.

First Condition Determination Process

In the present embodiment, the first condition includes (i) and (ii) described below.

-   (i) The user's current behavior includes a behavior predefined as a     relaxation behavior. -   (ii) First content included in information on communication content     of a communication tool and second content included in information     indicating the user's shopping history are the same.

If (i) and (ii) described above are satisfied, it is estimated that the user, who is interested in the first content, is relaxing.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 6. FIG. 6 is a flow chart illustrating one example of the determination process for the first condition according to Embodiment 1.

First, determiner 104 determines whether the user's current behavior includes a behavior predefined as a relaxation behavior (S1021). In other words, determiner 104 determines whether (i) described above is satisfied or not.

The user's current behavior is obtained by sensor group 300. For example, the user's current behavior can be obtained by performing behavior recognition on images of the user captured by an image sensor. The user's current behavior may also be obtained using a sensor value of a wearable sensor worn by the user.

One non-limiting example of a relaxation behavior is absentmindedly watching television or looking at a smartphone.

When the user's current behavior includes the predefined behavior (Yes in S1021), determiner 104 determines whether first content included in information on communication content of a communication tool and second content included in information indicating the user's shopping history are the same (S1022). In other words, determiner 104 determines whether (ii) described above is satisfied or not.

For example, when the content of communication via a communication tool includes foreign language correspondence between the user and a friend from a foreign country and the user's shopping history includes the purchase of foreign language educational material, determiner 104 determines that the first content (foreign language) and the second content (foreign language) are the same.

When the first content and the second content are the same (Yes in S1022), determiner 104 determines that the first condition is satisfied (S1026). However, when the user's current behavior does not include the predefined behavior (No in S1021) or the first content and the second content are not the same (No in S1022), determiner 104 determines that the first condition is not satisfied (S1027).

Note that the order of the steps illustrated in FIG. 6 is not limited to the illustrated order. For example, steps S1021 and S1022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A sensor is disposed in space 20. The processor can: obtain, via the sensor, a current behavior of a user; obtain, from the memory, information indicating a predefined behavior predefined as a relaxation behavior; obtain, from the memory, information on communication content of a communication tool; obtain, from the memory, information indicating a shopping history of the user; when (i) the current behavior of the user includes the predefined behavior and (ii) first content included in the information on the communication content and second content included in the information indicating the shopping history are the same content, generate first information indicating that the user who is interested in the first content is relaxing; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or space 20, using the first information generated.

This makes it possible to determine that the user, who is interested in the first content, is relaxing. Accordingly, it is possible to output information for identifying a user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Embodiment 2

Next, Embodiment 2 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that the user feels cold, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes at least (iii) and (iv) described below.

-   (iii) The current temperature is lower than a past statistical     temperature by a threshold temperature or more. -   (iv) The user's current activity includes an activity predefined as     an activity of looking for clothes.

In addition to (iii) and (iv) described above, or instead of at least one of (iii) or (iv) described above, the first condition may include the following stipulation: the user operates a given function (for example, activating (turning on) the device or increasing the temperature setting) of an electronic device capable of increasing the temperature of space 20 (for example, an air conditioner or a heater).

If at least (iii) and (iv) described above are satisfied, it is estimated that the user feels cold.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 7. FIG. 7 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 2.

First, determiner 104 determines whether the current temperature of space 20 is lower than a past statistical temperature by a threshold temperature or more (S2021). In other words, determiner 104 determines whether (iii) described above is satisfied or not.

The current temperature of space 20 is obtained by a temperature sensor disposed in space 20.

The past statistical temperature of space 20 is a temperature obtained by implementing statistical processing on temperatures obtained in a given span of time in the past by the temperature sensor. For example, the average value or the mean value or the like of past temperatures can be used as the statistical temperature.

When the current temperature is lower than the past statistical temperature by the threshold temperature or more (Yes in S2021), determiner 104 determines whether the user's current activity includes an activity predefined as an activity of looking for clothes (S2022). In other words, determiner 104 determines whether (iv) described above is satisfied or not.

The user's current activity is obtained by sensor group 300. For example, the user's current activity can be obtained by performing activity recognition on images of the user captured by an image sensor. The user's current activity may also be obtained using a sensor value of a wearable sensor worn by the user.

One non-limiting example of an activity of searching for clothes is opening the door of a closet.

When the user's current activity includes the predefined activity (Yes in S2022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that the user feels cold.

However, when the current temperature is not lower than the past statistical temperature by the threshold temperature or more (No in S2021) or the user's current activity does not include the predefined activity (No in S2022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 7 is not limited to the illustrated order. For example, steps S2021 and S2022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

Here, in the present embodiment, second information processing apparatus 200 can, as the first service information, output a control signal that activates a heater (for example, an air conditioner or a floor heater). Moreover, for example, second information processing apparatus 200 may, as the first service information, output to a display panel information related to a food or beverage or medicine for preventing the body from feeling cold. Moreover, for example, second information processing apparatus 200 may, as the first service information, output a control signal to the hot water unit for heating the bath tub.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A first sensor and a second sensor are disposed in space 20, the second sensor being a temperature sensor. The processor can: obtain, via the second sensor, a current temperature of space 20; obtain, from the memory, a past statistical temperature of space 20; obtain, via the first sensor, a current activity of a user; when (iii) the current temperature is lower than the past statistical temperature by a threshold temperature or more and (iv) the current activity of the user includes a predefined activity predefined as an activity of looking for clothes, generate first information indicating that the user feels cold; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or space 20, using the first information generated.

This makes it possible to determine that the user feels cold, by using the temperature of space 20 and the user's activity obtained by sensors. Accordingly, it is possible to output information for identifying the user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Embodiment 3

Next, Embodiment 3 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates conditions are suitable for ventilating the space, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes (v) through (vii) described below.

-   (v) A given amount of time or more has elapsed from the most recent     date and time included in a past ventilation history of space 20 to     the current date and time. -   (vi) The weather information for the location of space 20 indicates     weather that is predefined as weather suitable for ventilation. -   (vii) The pollution level of the air in space 20 is a given     pollution level or higher.

If (v) through (vii) described above are satisfied, it is estimated that conditions are suitable for ventilating the space.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 8. FIG. 8 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 3.

First, determiner 104 determines whether a given amount of time or more has elapsed from the most recent date and time included in the past ventilation history of space 20 to the current date and time (S3021). In other words, determiner 104 determines whether (v) described above is satisfied or not.

Past ventilation history of space 20 can be derived from sensor data obtained by sensor group 300 in the past. For example, the dates and times that space 20 was ventilated is recorded in first memory 103 based on data obtained from a sensor that detects whether an electronic device for ventilating space 20 is active or not, a sensor for detecting whether a window is open or closed, a temperature sensor, or any combination thereof.

FIG. 9 illustrates one example of the past ventilation history of space 20 according to Embodiment 3. FIG. 9 illustrates the ventilation history for the living room. The ventilation history for the living room illustrated in FIG. 9 shows that the most recent ventilation date and time is 13:00 on Jun. 5, 2018.

As used herein, the term “current date and time” is not limited to the precise current date and time, but includes dates and times that would usually be considered to be essentially the current date and time. For example, the current date and the current time as defined by a system (commonly referred to as the system time) may be used as the “current date and time”.

The given amount of time is an amount of time for discerning that a long time has elapsed since the last ventilation. An amount of time registered in advance by the user may be used as the given amount of time, and, alternatively, a statistical value of intervals between ventilations in the past ventilation history of space 20 may be used.

When the given amount of time or more has elapsed from the most recent date and time included in the past ventilation history of space 20 to the current date and time (Yes in S3021), determiner 104 determines whether the weather information for the location of space 20 indicates weather that is predefined as weather suitable for ventilation (S3022). In other words, determiner 104 determines whether (vi) described above is satisfied or not.

For example, the weather information for the location of space 20 is obtained from an external server. The weather information for the location of space 20 may be obtained by a sensor disposed outside space 20. The weather information for the location of space 20 may include atmospheric temperature, humidity, wind direction, wind speed, or any combination thereof.

Weather suitable for ventilation is predefined by atmospheric temperature, humidity, wind direction, wind speed, or any combination thereof. Weather suitable for ventilation may be predefined simply as “clear skies”.

When the weather information for the location of space 20 indicates weather that is predefined as weather suitable for ventilation (Yes in S3022), determiner 104 determines whether the pollution level of the air in space 20 is a given pollution level or higher (S3023). In other words, determiner 104 determines whether (vii) described above is satisfied or not.

For example, a carbon dioxide concentration level and/or an odor level can be used as the air pollution level.

The given pollution level is a threshold pollution level for determining that the air in space 20 is polluted. A pollution level registered in advance by the user may be used as the given pollution level, and, alternatively, a statistical value of past pollution levels of the air in space 20 before ventilation may be used as the given pollution level.

When the pollution level of the air in space 20 is the given pollution level or higher (Yes in S3023), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that conditions are suitable for ventilating space 20.

However, when the given amount of time or more has not elapsed from the most recent date and time included in the past ventilation history of space 20 to the current date and time (No in S3021), the weather information for the location of space 20 does not indicate weather that is predefined as weather suitable for ventilation (No in S3022), or the pollution level of the air in space 20 is not the given pollution level or higher (No in S3023), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 8 is not limited to the illustrated order. For example, steps S3021 through S3023 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

For example, in the present embodiment, second information processing apparatus 200 can, as the first service information, output information for suggesting ventilation. Moreover, second information processing apparatus 200 may, as the first service information, output a control signal for activating a ventilation fan in space 20. Moreover, second information processing apparatus 200 may, as the first service information, output information for suggesting washing clothes or sheets or the like and drying the clothes or sheets or the like outside.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A first sensor and a second sensor are disposed in space 20, the second sensor being a temperature sensor. The processor can: obtain, from the memory, a past ventilation history of space 20 based on sensor data from the second sensor; obtain weather information corresponding to a location of space 20; obtain, from the memory, predefined weather predefined as weather suitable for ventilation; obtain, via the first sensor, air information indicating a pollution level of air in space 20; when (v) a given amount of time or more has elapsed from a most recent date and time included in the past ventilation history of space 20 to a current date and time, (vi) the weather information indicates the predefined weather, and (vii) the pollution level of the air in space 20 is a given pollution level or higher, generate first information indicating that conditions are suitable for ventilating space 20; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying a user or space 20, using the first information generated.

This makes it possible to determine that conditions are suitable for ventilating space 20, by using the pollution level and temperature of space 20 obtained by the first sensor and the second sensor. Accordingly, it is possible to output information for identifying a user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Note that in the present embodiment, weather suitable for ventilation may be determined based on ventilation information indicating ventilation status in the surrounding area of space 20 rather than based on the weather information.

Embodiment 4

Next, Embodiment 4 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that the time to perform maintenance of an object is approaching, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes (viii) and (ix) described below.

-   (viii) The degree of dirtiness of the object is greater than a given     degree of dirtiness. -   (ix) A given amount of time or more has elapsed from the most recent     maintenance date and time included in a maintenance history of the     object to the current date and time.

If (viii) and (ix) described above are satisfied, it is estimated that the time to perform maintenance of the object is approaching.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to

FIG. 10. FIG. 10 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 4.

First, determiner 104 determines whether the degree of dirtiness of the object is greater than a given degree of dirtiness (S4021). In other words, determiner 104 determines whether (viii) described above is satisfied or not.

The object is a tangible object disposed in space 20. Examples of the object include automobiles, the exterior of a building (for example, the outside wall or the roof or the like), the interior of a building (for example, wallpaper or wall fabric), household items (for example, an air conditioner, an air purifier, a ventilation fan or the like), and accessories (for example, shoes, bags, clocks, or the like).

The degree of dirtiness of the object is obtained by a sensor. Specifically, the degree of dirtiness of the object is obtained, for example, by analyzing an image of the object captured by an image sensor.

The given degree of dirtiness is a threshold for discerning that the object is unacceptably dirty. For example, a degree of dirtiness registered in advance by the user may be used as the given degree of dirtiness, and, alternatively, a degree of dirtiness obtained by implementing statistical processing on degrees of dirtiness obtained in a past given span of time may be used as the given degree of dirtiness.

When the degree of dirtiness of the object is greater than the given degree of dirtiness (Yes in S4021), determiner 104 determines whether a given amount of time or more has elapsed from the most recent maintenance date and time included in the maintenance history of the object to the current date and time (S4022). In other words, determiner 104 determines whether (ix) described above is satisfied or not.

The maintenance history of the object is information including dates and times that the object received maintenance in the past, and, for example, is stored in first memory 103. FIG. 11 illustrates one example of the maintenance history of the object according to Embodiment 4. FIG. 11 illustrates the maintenance history of object A. The most recent maintenance date and time included in the maintenance history of object A is 13:00 on Jun. 5, 2018.

As used herein, the term “current date and time” is not limited to the precise current date and time, but includes dates and times that would usually be considered to be essentially the current date and time, just like in Embodiment 3. For example, the current date and the current time as defined by a system (commonly referred to as the system time) may be used as the “current date and time”.

The given amount of time is a threshold for discerning when maintenance of the object is required. For example, an amount of time registered in advance by the user may be used as the given amount of time, and, for example, an amount of time obtained by implementing statistical processing on past maintenance intervals or frequencies included in the maintenance history may be used as the given amount of time.

When determiner 404 determines that the given amount of time or more has elapsed from the most recent maintenance date and time to the current date and time (Yes in S4022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that the time to perform maintenance of the object is approaching.

However, when the degree of dirtiness of the object is not greater than the given degree of dirtiness (No in S4021) or the given amount of time or more has not elapsed from the most recent maintenance date and time to the current date and time (No in S4022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 10 is not limited to the illustrated order. For example, steps S4021 and S4022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

For example, in the present embodiment, second information processing apparatus 200 can, as the first service information, output, to a display panel, information related to maintenance of the object. Moreover, for example, when the object is an automobile, second information processing apparatus 200 may, as the first service information, output information for a car wash near space 20 and a coupon for the car wash, and may output an advertisement for car washing accessories.

Moreover, second information processing apparatus 200 may output different first service information depending on the frequency of use of the object, frequency of maintenance of the object, cost of the object, or any combination thereof. In such cases, the second information may include information on the frequency of use of the object, frequency of maintenance of the object, cost of the object, or any combination thereof. This makes it possible for the service provider to provide services suitable for how particular the user is about the object.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. An object and a sensor are disposed in space 20. The processor can: obtain, via the sensor, a degree of dirtiness of the object; obtain, from the memory, a past maintenance history of the object; when (viii) the degree of dirtiness of the object obtained is greater than a given degree of dirtiness and (ix) a given amount of time or more has elapsed from a most recent maintenance date and time included in the past maintenance history of the object to a current date and time, generate first information indicating that a time to perform maintenance of the object is approaching; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying a user or space 20, using the first information generated.

This makes it possible to determine that the time to perform maintenance of an object is approaching, by using, for example, the degree of dirtiness of the object obtained by a sensor. Accordingly, it is possible to output information for identifying the user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Embodiment 5

Next, Embodiment 5 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that mealtime will soon begin in the dining space, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes (x) and (xi) described below.

-   (x) The current sensing information includes information indicating     at least one of the user being present in the kitchen space or a     first electronic device in the kitchen space being active. -   (xi) An amount of time from the current time to a statistical time     indicating at least one of the user being present in the dining     space in the past or a second electronic device in the dining space     being active in the past is a given amount of time or less.

If (x) and (xi) described above are satisfied, it is estimated that mealtime will soon begin in the dining space.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 12. FIG. 12 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 5.

First, determiner 104 determines whether the current sensing information includes information indicating at least one of the user being present in the kitchen space or a first electronic device in the kitchen space being active (S5021). In other words, determiner 104 determines whether (x) described above is satisfied or not.

The current sensing information is obtained from the first sensor disposed in the kitchen space of the home. A motion sensor, an image sensor, a door sensor, an ON/OFF sensor provided in the first electronic device disposed in the kitchen space, or any combination thereof can be used as the first sensor.

Examples of the first electronic device include a luminaire and a cooking appliance (for example, an induction cooktop, gas cooktop, a microwave oven, a rice cooker, or a coffee maker or the like).

When the current sensing information includes information indicating at least one of the user being present in the kitchen space or a first electronic device in the kitchen space being active (Yes in S5021), determiner 104 determines whether the amount of time from the current time to a statistical time indicating at least one of the user being present in the dining space in the past or a second electronic device in the dining space being active in the past is a given amount of time or less (S5022). In other words, determiner 104 determines whether (xi) described above is satisfied or not.

As used herein, the term “current” is not limited to the precise current time, but includes times that would usually be considered to be essentially the current time. For example, the current time as defined by a system (commonly referred to as the system time) may be used as the “current time”.

A statistical time is a point in time obtained by implementing statistical processing on times indicating at least one of the user being present in the dining space in the past or the second electronic device in the dining space being active in the past. Next, the statistical time will be described in greater detail with reference to FIG. 13 and FIG. 14.

FIG. 13 illustrates one example of past sensing information related to the activity of the second electronic device according to Embodiment 5. In FIG. 13, time is represented on the horizontal axis, and days are represented on the vertical axis. The double-headed arrows indicate the time that the second electronic device is active.

The second electronic device is included in device group 400 and is disposed in the dining space. One example of the second electronic device is a luminaire or the like.

In FIG. 13, a statistical value (for example, the average value or mean value) of start times of active periods of the second electronic device that fall within a predefined period (for example, between 17:00 and 20:00) across a given span of time (for example, a week, a month, or three months back from the current day, or the same month from last year) can be used as the statistical time. The statistical time is stored in first memory 103 as past sensing statistical information.

FIG. 14 illustrates one example of past sensing information obtained by the motion sensor according to Embodiment 5. In FIG. 14, time is represented on the horizontal axis, and days are represented on the vertical axis. The double-headed arrows indicate periods that a person was detected by the motion sensor (hereinafter referred to as detection periods). The motion sensor is included in sensor group 300 and is disposed in the dining space.

In FIG. 14, a statistical value (for example, the average value or mean value) of start times of detection periods that fall within a predefined period (for example, between 17:00 and 20:00) across a given span of time (for example, a week, a month, or three months back from the current day, or the same month from last year) can be used as the statistical time. The statistical time is stored in first memory 103 as past sensing statistical information.

In the description of FIG. 13 through FIG. 14, in the calculation of the statistical time, outlier start times may be removed from the population. An outlier value can be calculated using, for example, a known statistics method. Furthermore, start times that fall on weekdays or holidays may be removed from the population when the statistical time is calculated.

The given amount of time is an amount of time for discerning that the current time is sufficiently close to the statistical time. An amount of time registered in advance by the user may be used as the given amount of time, and, alternatively, an amount of time based on a statistical value (for example, a standard deviation or the like) of start times of detection periods or active periods across a given span of time in the past may be used as the given amount of time.

We will now return to the description of the flowchart illustrated in FIG. 12. When the amount of time from the current time to the statistical time is the given amount of time or less (Yes in S5022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that the mealtime will soon begin in the dining space.

However, when the current sensing information does not include information indicating at least one of the user being present in the kitchen space or a first electronic device being active in the kitchen space (No in S5021) or the amount of time from the current time to the statistical time indicating at least one of the user being present in the dining space in the past or a second electronic device in the dining space being active in the past is not a given amount of time or less (No in S5022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 12 is not limited to the illustrated order. For example, steps S5021 and S5022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

For example, in the present embodiment, second information processing apparatus 200 can, as the first service information, output, to a display panel, information related to a meal. Moreover, for example, second information processing apparatus 200 may, as the first service information, output information related to a delivery arrival time of an ingredient or information related to an ingredient stored in the refrigerator. In such cases, the second information may include information related to the delivery arrival time of the ingredient or information related to the ingredient stored in the refrigerator.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A first sensor and a first electronic device are disposed in a kitchen space of a home. A second sensor and a second electronic device are disposed in a dining space of the home. The processor can: obtain, via the first sensor, current sensing information corresponding to the kitchen space; obtain, from the memory, past sensing statistical information corresponding to the dining space; when (x) the current sensing information includes information indicating at least one of a user being present in the kitchen space or the first electronic device in the kitchen space being active and (xi) an amount of time from a current time to a statistical time included in the past sensing statistical information is a given amount of time or less, generate first information indicating that a mealtime will soon begin in the dining space, the statistical time indicating at least one of the user being present in the dining space or the second electronic device in the dining space being active; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or the home, using the first information generated.

This makes it possible to determine that the time to perform maintenance of an object is approaching, by using, for example, the degree of dirtiness of the object obtained by a sensor. Accordingly, it is possible to output information for identifying a user or home that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or home. It is therefore possible to effectively use sensor data to provide services.

Embodiment 6

Next, Embodiment 6 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that the user is about to wash laundry in the washing machine, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes (xii) and (xiii) described below.

-   (xii) The type of stain on the laundry is obtained by a sensor. -   (xiii) A washing mode suitable for the type of stain on the laundry     is selected from among washing modes of the washing machine.

If (xii) and (xiii) described above are satisfied, it is estimated that the user is about to wash laundry in the washing machine.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 15. FIG. 15 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 6.

First determiner 104 determines whether the type of stain on the laundry to be washed in the washing machine is obtained by a sensor or not (S6021). In other words, determiner 104 determines whether (xii) described above is satisfied or not.

For example, the type of stain on the laundry is detected by a stain sensor in the washing machine upon the laundry being placed in the washing machine. The type of stain on the laundry may be detected by a stain sensor external to the washing machine when the user brings the laundry near the stain sensor.

Examples of types of stains include oil-based stains, insoluble stains, water-soluble stains, etc. An oil-based stain is detected based on the viscosity of the stain, for example. An insoluble stain is detected based on the number of solid particles, for example. A water-soluble stain is detected when neither an oil-based stain nor an insoluble stain is detected, for example.

When the type of stain on the laundry is detected (Yes in S6021), determiner 104 determines whether a washing mode suitable for the type of stain on the laundry is selected from among washing modes of the washing machine (S6022).

The washing modes are modes for achieving mutually different washing operations. The washing modes include, for example, a dry cleaning mode, a soak mode, and a regular mode. The dry cleaning mode is a mode for washing laundry by utilizing the centrifugal force of the washing drum to soak the detergent into the laundry with a gentle water current. The soak mode is a mode for washing laundry by soaking the detergent into the laundry for a long period of time to lift the stains from the laundry. The regular mode is a mode for washing laundry using a standard method. Note that the washing modes are not limited to these examples and may include other washing modes.

The washing machine can suggest to the user a pretreatment for the laundry and/or a washing machine washing mode, based on the type of stain on the laundry obtained by the sensor. For example, when the type of stain is an oil-based stain, the washing machine suggests to the user, as a pretreatment, prewashing the laundry by hand with dishwashing soap or a bar of soap, and, as washing modes, the dry cleaning mode and the soak mode. Moreover, for example, when the type of stain is an insoluble stain, the washing machine suggests, as a pretreatment, washing by rubbing, and, as washing modes, the dry cleaning mode and the regular mode. Moreover, for example, when the type of stain is a water-soluble stain, the washing machine suggests, as a pretreatment, adding a bleaching agent to the washing machine, and, as a washing mode, the regular mode. Note that the above-described relationships between the types of stains and the preprocessing and washing modes are non-limiting examples.

The user selects a washing mode based on the type of stain on the laundry, based on the suggestion by the washing machine. In other words, the washing machine receives a selection of a washing mode from the user based on the type of stain on the laundry.

When the washing mode is selected (Yes in S6022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that the user is about to wash laundry using the washing machine.

However, when the type of stain on the laundry is not obtained (No in S6021) or the washing mode is not selected (No in S6022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 15 is not limited to the illustrated order. For example, steps S6021 and S6022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

For example, in the present embodiment, second information processing apparatus 200 can, as the first service information, output, to a display panel, information about a detergent corresponding to the type of stain on the laundry and the selected washing mode. In such cases, the second information may include information indicating the type of stain on the laundry and the selected washing mode.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A washing machine and a sensor are disposed in space 20. The processor can: when (xii) a type of a stain on laundry to be washed in the washing machine is obtained by the sensor and (xiii) a washing mode suitable for the type of the stain on the laundry is selected from among washing modes of the washing machine, generate first information indicating that a user is about to wash the laundry using the washing machine; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or space 20, using the first information generated.

This makes it possible to determine that the user is about to wash laundry using the washing machine, by using, for example, the type of stain on the laundry obtained by the sensor. Accordingly, it is possible to output information for identifying a user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Embodiment 7

Next, Embodiment 7 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that the user is about to start preparing a given food or drink using a cooking appliance, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes (xiv) and (xv) described below.

-   (xiv) Activity information includes an activity of the user holding     a given food or drink in their hand. -   (xv) User-operation information includes a user operation predefined     as operation of a cooking appliance by the user for starting     preparation of the given food or drink.

If (xiv) and (xv) described above are satisfied, it is estimated that the user is about to start preparing the given food or drink using the cooking appliance.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 16. FIG. 16 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 7.

First, determiner 104 determines whether the activity information includes an activity of the user holding a given food or drink in their hand (S7021). In other words, determiner 104 determines whether (xiv) described above is satisfied or not.

The activity information is obtained by a sensor included in sensor group 300 and disposed in space 20. For example, an image sensor or the like can be used as the sensor. A conventional technique may be used to obtain the activity information. For example, a technique of recognizing an activity using image analysis can be used, but this example is not limiting.

Examples of the given food or drink include, but are not particularly limited to, a croquette, a fried pork cutlet, rice, a potato, pumpkin, or any combination thereof.

When the activity information includes an activity of the user holding the given food or drink in their hand (Yes in S7021), determiner 104 determines whether the user-operation information includes a user operation predefined as operation of a cooking appliance by the user for starting preparation of the given food or drink (S7022). In other words, determiner 104 determines whether (xv) described above is satisfied or not.

Examples of the cooking appliance include a microwave oven, a combination microwave convection oven, and a rice cooker.

For example, the user-operation information is obtained by a sensor in the cooking appliance. Information indicating a user operation predefined as operation of a cooking appliance by the user for starting preparation of the given food or drink is stored in first memory 103, for example. Examples of the predefined user operation include opening the door of the microwave oven or the combination microwave convection oven, and opening the lid of the rice cooker.

When the user-operation information includes the predefined user operation (Yes in S7022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that the user is about to start preparing the given food or drink using the cooking appliance.

However, when the activity information does not include the activity of the user holding a given food or drink in their hand (No in S7021) or the user-operation information does not include a predefined user operation (No in S7022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 16 is not limited to the illustrated order. For example, steps S7021 and S7022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

For example, in the present embodiment, second information processing apparatus 200 can, as the first service information, output a software program for running the cooking appliance in a mode for preparing the given food or drink. For example, when the given food or drink is a croquette and the cooking appliance is a microwave oven, second information processing apparatus 200 provides the microwave oven with a software update that allows the microwave oven to run in a mode for heating the croquette in a way that gives it a crispy texture. Moreover, for example, when the given food or drink is pumpkin and the cooking appliance is a combination microwave convection oven, second information processing apparatus 200 provides the combination microwave convection oven with a software update that allows the combination microwave convection oven to run in a new mode for cooking pumpkin. When providing such a service, the second information may include information for specifying the given food or drink and the cooking appliance.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A sensor and a cooking appliance are disposed in space 20. The processor can: obtain, via the sensor, current activity information of a user in space 20; obtain current user-operation information of the cooking appliance; when (xiv) the activity information includes an activity of the user holding a given food or drink in hand and (xv) the current user-operation information includes a predefined user operation predefined as operation of the cooking appliance by the user for starting preparation of the given food or drink, generate first information indicating that the user is about to start preparing the given food or drink using the cooking appliance; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or space 20, using the first information generated.

This makes it possible to determine that the user is about to start preparing a given food or drink using a cooking appliance, by using the user's activity information and the user-operation information of a cooking appliance, obtained by a sensor or sensors. Accordingly, it is possible to output information for identifying a user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Embodiment 8

Next, Embodiment 8 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that a user is moving from one space to another while an electronic device that outputs at least one of sound or video is active, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.

Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.

First Condition Determination Process

In the present embodiment, the first condition includes (xvi) and (xvii) described below.

-   (xvi) An electronic device that outputs at least one of sound or     video is active. -   (xvii) A user is moving from space 20 to another space.

If (xvi) and (xvii) described above are satisfied, it is estimated that the user is moving from space 20 to another space while the electronic device that outputs at least one of sound or video is active.

Next, the determination process for such a first condition (S102 in FIG. 5) will be described in greater detail with reference to FIG. 17. FIG. 17 is a flow chart illustrating one example of the determination process for the first condition (S102) according to Embodiment 8.

First, determiner 104 determines whether an electronic device that outputs at least one of sound or video is active or not based on device activity information of the electronic device (S8021). In other words, determiner 104 determines whether (xvi) described above is satisfied or not.

Examples of an electronic device that outputs at least one of sound or video include a television receiver, a tablet computer, an audio device, or any combination thereof.

For example, the device activity information of the electronic device can be obtained by a sensor in the electronic device or an image sensor or microphone or the like disposed in space 20.

If the electronic device is active (Yes in S8021), determiner 104 determines whether the user is moving from space 20 to another space, based on the user's activity information (S8022). In other words, determiner 104 determines whether (xvii) described above is satisfied or not.

The user's activity information is obtained by a sensor included in sensor group 300 and disposed in space 20. For example, an image sensor or the like can be used as the sensor. A conventional technique may be used to obtain the activity information. For example, a technique of recognizing an activity using image analysis can be used, but this example is not limiting.

When the user is moving from space 20 to another space (Yes in S8022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in FIG. 5 is performed. Here, the first information generated in step S103 indicates that the user is moving from space 20 to another space while the electronic device that outputs at least one of sound or video is active.

However, when the electronic device is inactive (No in S8021) or the user is not moving from space 20 to another space (No in S8022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in FIG. 5 is skipped and step S111 and subsequent processes are executed.

Note that the order of the steps illustrated in FIG. 17 is not limited to the illustrated order. For example, steps S8021 and S8022 may be performed in the reverse order, and, alternatively, may be performed in parallel.

Service Information

For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).

For example, in the present embodiment, second information processing apparatus 200 can, as the first service, suggest a service, software program, electronic device, or any combination thereof that enables the user to continue listening to or watching the sound or video in the other space. For example, when the user is listening to music being output by a speaker in the living room and the user leaves the living room to go to the bathroom, this makes it possible to continue playing the music through speakers in the hallway and bathroom as the user moves through these spaces, preventing the user from having to interrupt their music listening or from missing part of the music while out of the living room.

Advantageous Effects, etc.

As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A sensor and an electronic device that outputs at least one of sound or video are disposed in space 20. The processor can: obtain device activity information of the electronic device; obtain, via the sensor, activity information of a user; when (xvi) the device activity information indicates that the electronic device is active and (xvii) the activity information indicates that the user is moving from space 20 to another space, generate first information indicating that the user is moving from space 20 to the another space while the electronic device is active; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or space 20, using the first information generated.

This makes it possible to determine that the user is moving from space 20 to another space while an electronic device that outputs at least one of sound or video is active, by using, for example, the user's activity information obtained by a sensor. Accordingly, it is possible to output information for identifying a user or space 20 that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or space 20. It is therefore possible to effectively use sensor data to provide services.

Variation 1

Next, Variation 1 of the above embodiments will be described. The present variation mainly varies from the embodiments in that services are provided via first information processing apparatus 100. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.

Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted.

Interaction in Service Providing System 10

FIG. 18 is a sequence diagram for service providing system 10 according to Variation 1. As illustrated in FIG. 18, after generating the first service information (S121), second information processing apparatus 200 according to the present variation outputs the first service information to first information processing apparatus 100 (S122A). First information processing apparatus 100 transfers the first service information obtained from first information processing apparatus 100 to device group 400 (S122B). First information processing apparatus 100 may transmit record information on the provision of the first service information to second information processing apparatus 200. Examples of the record information include the number of times that the first service information has been provided, and attribute information related to a user or space 20. Attribute information is information that cannot identify a user or space 20. Examples of attribute information include geographical information on the user and demographics of the user. Note that the record information may be limited to information that has been permitted to be transmitted by the user in advance.

Advantageous Effects, etc.

As described above, with service providing system 10 according to the present variation, second information processing apparatus 200 can restrict disclosure of information related to space 20 to second information processing apparatus 200 since it is not necessary to directly communicate with device group 400 disposed in space 20. Accordingly, the privacy of users in space 20 can be protected.

Variation 2

Next, Variation 2 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that the transmission of the first request information from second information processing apparatus 200 to first information processing apparatus 100 is performed before, rather than after, the generation of the first information (S103). The present variation will be described with reference to the figures, with focus on the differences from the embodiments.

Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted.

Interaction in Service Providing System 10

FIG. 19 is a sequence diagram for service providing system 10 according to Variation 2. As illustrated in FIG. 19, first information processing apparatus 100 according to the present variation obtains the first request information (S111) before obtaining the first sensor data (S101).

It is sufficient so long as the obtainment of the first request information (S111) is performed before the determining of whether the first request is satisfied (S112); the obtainment of the first request information (S111) is not limited to being performed before the obtainment of the first sensor data (S101). Moreover, since the first request has already been transmitted, second information processing apparatus 200 may request to obtain information regarding when to determine whether the first condition is satisfied (S102). If the first sensor data is consecutively received in a time series and whether the first condition is satisfied or not (S102) is determined upon each instance of reception of the first sensor data, it may be possible to obtain information at the point in time that the situation changes in a way to satisfy the first condition, by obtaining first sensor data information that does not meet the first condition immediately before first data that does satisfy the first condition is received. For example, the second information may be first sensor data information that (i) is obtained immediately before the first condition is satisfied and (ii) does not satisfy the first condition. Moreover, first information processing apparatus 100 may suggest to second information processing apparatus 200 to change the first condition, depending on the result of an analysis of statistical information on the first sensor data information that (i) is obtained immediately before the first condition is satisfied and (ii) does not satisfy the first condition.

Advantageous Effects, etc.

As described above, with service providing system 10 according to the present variation, it is possible to output the second information regardless of the timing of the obtainment of the first request information, and possible to provide second information that is timely.

Variation 3

Next, Variation 3 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that the second information includes, in addition to information for identifying a user or space, device activity information for a device related to a service. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.

Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted. The interaction in service providing systems 10 and 10A and the processes performed by first information processing apparatus 100 are as illustrated in FIG. 6 through FIG. 9. Accordingly, repeated illustration and description will be simplified or omitted.

Process for Generating Second Information

Next, the process for generating the second information (S113 in FIG. 5) according to the present variation will be described in greater detail with reference to FIG. 20. FIG. 20 is a flow chart illustrating one example of the process for generating the second information (S113) according to Variation 3. Note that in the present variation, the first request information includes information for identifying the service provided by second information processing apparatus 200.

First information processing apparatus 100 selects a device related to the service identified by the first request information from among device group 400 disposed in space 20 in which the first information was generated (S1131). For example, first information processing apparatus 100 selects a device from among device group 400 based on the effect the service has on the user's five senses (sight, hearing, smell, touch, and taste) and the effect the device has on the user's five senses.

FIG. 21A illustrates one example of information indicating relationships between services and the five senses. FIG. 21B illustrates one example of information indicating relationships between devices and the five senses. In FIG. 21A and FIG. 21B, a check indicates that the service or device affects the corresponding sense, and a dash indicates that the service or device does not affect the corresponding sense.

For example, FIG. 21A shows that service 1 affects the senses of sight and hearing and does not affect the senses of smell or touch (back, waist, and eyes). For example, FIG. 21B shows that the television affects the senses of sight and hearing and does not affect the senses of smell or touch (back, waist, and eyes).

When, for example, service 1 is identified by the first request information, first information processing apparatus 100 selects, from among the devices illustrated in FIG. 21B, the television and the speaker which are associated with the sense of sight or the sense of hearing that are affected by service 1 as illustrated in FIG. 21A.

Next, first information processing apparatus 100 obtains device activity information for the selected device(s) (S1132). The device activity information is information indicating whether the device is active. For example, the device activity information may be obtained directly from the device(s), or may be obtained via a sensor or sensors.

First information processing apparatus 100 then generates the second information including the device activity information (S1133).

Advantageous Effects, etc.

As described above, according to the present variation, it is possible for the second information to include the device activity information for a device. Accordingly, second information processing apparatus 200 can provide a service that activates a device in an inactive state, and can avoid competition with services for devices that are operating. For example, when there are many devices that are in an active state, second information processing apparatus 200 can avoid causing multiple devices to confuse the senses of the user.

Although the second information includes the device activity information for selected devices in the present variation, this example is non-limiting. For example, the second information may include the device activity information for all devices. Moreover, the device activity information may be output separately from the second information.

The second information may moreover include only device activity information for devices that have been permitted to provide the device activity information by the user. Moreover, when there is a device that has been denied permission to provide the device activity information by the user, the second information may include information indicating that the device has been denied permission to provide the device activity information by the user. For example, when second information processing apparatus 200 provides a service using a device that has been denied permission to provide the operation information by the user, second information processing apparatus 200 may request permission from the user to provide the service.

Variation 4

Next, Variation 4 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that the second information includes, in addition to information for identifying a user or space, suitability information indicating service provision suitability. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.

Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted. The interaction in service providing systems 10 and 10A and the processes performed by first information processing apparatus 100 are as illustrated in FIG. 6 through FIG. 9. Accordingly, repeated illustration and description will be simplified or omitted.

Process for Generating Second Information

Next, the process for generating the second information (S113 in FIG. 5) according to the present variation will be described in greater detail with reference to FIG. 22. FIG. 22 is a flow chart illustrating one example of the process for generating the second information (S113) according to Variation 4. Note that in the present variation, the first request information includes information for identifying the service provided by second information processing apparatus 200.

First information processing apparatus 100 obtains a service provision history for space 20 or the user (S1134). Service provision history is information associating services provided in the past to space 20 or the user with the date and time that those services were provided.

FIG. 23 illustrates one example of the service provision history according to Variation 4. In FIG. 23, time is represented on the horizontal axis, and days are represented on the vertical axis. The double-headed arrows indicate the time that a service was or will be provided to space 20 or the user. For example, service 1 was provided twice between 18:00 and 24:00 on Jun. 2, 2018. Note that the service provision history can include a plurality of different services provided by a plurality of different second information processing apparatuses 200 (in other words, a plurality of different service providers).

Next, first information processing apparatus 100 evaluates the suitability of the provision of the service identified by the first request information for space 20 or the user, based on the obtained service provision history (S1135). More specifically, for example, first information processing apparatus 100 evaluates the suitability of the provision of the service identified by the first request information based on the number of times the service was provided in a given span of time. As another example, first information processing apparatus 100 may evaluate the suitability of the provision of the service identified by the first request information based on another service that is currently being provided.

Next, specific examples of the evaluation of the suitability of the service provision will be given with reference to FIG. 24A through FIG. 24C. FIG. 24A illustrates one example of service provision availability information according to Variation 4. For example, service provision availability information may be stored in advance in third memory 107, and, alternatively, may be obtained from an external server (not illustrated in the figures).

The service provision availability information indicates, for each service, the number of times per day that service can be provided, as well as situations in which that service cannot be provided. For example, the service provision availability information illustrated in FIG. 24A indicates that service 1 and service 3 both have no restrictions for how many times they can be provided per day, and that service 2 can only be provided once a day.

According to the service provision history illustrated in FIG. 23, on the current day (Jun. 7, 2018), service 1 and service 2 have already been provided. Accordingly, based on the service provision availability information illustrated in FIG. 24A, the suitability of the provision of services 1 and 3 is evaluated high, and the suitability of the provision of service 2 is evaluated low.

Moreover, the service provision availability information illustrated in FIG. 24A indicates that services 1 and 2 cannot be provided in user situations A and B, respectively. For example, a situation in which the user's activity is more delayed than usual may be used as user situations A and B. In such cases, by prohibiting the provision of less urgent services (for example, music playback or providing horoscope information), it is possible to provide services suitable to the user's situation. Moreover, for example, a state indicated by the first information generated in Embodiment 1 through Embodiment 8 may be used as user situations A and B.

FIG. 24B illustrates one example of information indicating services that are prohibited from being provided simultaneously according to Variation 4. For example, the information indicating services that are prohibited from being provided simultaneously may be stored in advance in third memory 107, and, alternatively, may be obtained from an external server (not illustrated in the figures).

The information indicating services that are prohibited from being provided simultaneously indicates, more specifically, pairs of services that are prohibited from being or allowed to be provided simultaneously. A check indicates the two services are prohibited from being provided simultaneously, while a dash indicates the two services are allowed to be provided simultaneously.

For example, the information illustrated in FIG. 24B indicates that service 1 is allowed to be provided simultaneously with services 2 and 3. In other words, service 1 can be provided along with each of service 2 and service 3. For example, the information illustrated in FIG. 24B also indicates that service 2 is prohibited from being provided simultaneously with service 3. In other words, the information indicates that service 2 cannot be provided along with service 3.

FIG. 24C illustrates one example of information indicating services that are prohibited from being changed according to Variation 4. For example, the information indicating services that are prohibited from being changed may be stored in advance in third memory 107, and, alternatively, may be obtained from an external server (not illustrated in the figures).

The information indicating services that are prohibited from being changed indicates, more specifically, services prohibited from being or allowed to be provided in place of a service that is already being provided. A check indicates that changing from the service on the left column to the service on the top row is prohibited, and a dash indicates that changing from the service on the left column to the service on the top row is allowed.

For example, in FIG. 24C, when service 1 is currently being provided, changing from service 1 to service 2 is prohibited. On the other hand, when service 2 is currently being provided, changing from service 2 to service 1 is allowed. Moreover, when service 2 is currently being provided, changing from service 2 to service 3 is also prohibited.

In the service provision history illustrated in FIG. 23, service 2 is being provided at the current time. However, based on the information indicating services that are prohibited from being provided simultaneously that is illustrated in FIG. 24B and the information indicating services that are prohibited from being changed that is illustrated in FIG. 24C, the suitability of the provision of service 1 is evaluated high and the suitability of the provision of service 3 is evaluated low.

Such an evaluation result is expressed as two or more levels. For example, two levels, namely “suitable” and “unsuitable”, can be used as the evaluation result. As another example, a number score from 0 to 10 or 0 to 100 can be used as the evaluation result.

Lastly, first information processing apparatus 100 generates the second information including suitability evaluation information indicating the evaluation result (S1136).

Advantageous Effects, etc.

As described above, according to the present variation, it is possible for the second information to include suitability evaluation information. Accordingly, second information processing apparatus 200 can, for example, skip the provision of a service when the service's suitability evaluation is low, and can thus inhibit the provision of services at inappropriate times. As a result, service providing systems 10 and 10A can reduce excessive provision of services and inhibit interference between services.

Although the second information includes the suitability evaluation information in the present variation, this example is non-limiting. For example, in addition to or instead of the suitability evaluation information, the second information may include the service provision history information. Moreover, the service suitability information may be output separately from the second information.

Variation 5

Next, Variation 5 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that, when first requests having the same request content have already been received from a plurality of second information processing apparatuses 200 (see Variation 2 above), the second information is output to a second information processing apparatus 200 selected based on priority level. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.

Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted.

The interaction in service providing systems 10 and 10A and the processes performed by first information processing apparatus 100 are as illustrated in FIG. 6 through FIG. 9. Accordingly, repeated illustration and description will be simplified or omitted.

Process for Outputting Second Information

Next, the process for outputting the second information (S114 in FIG. 5) according to the present variation will be described in greater detail with reference to FIG. 25. FIG. 25 is a flow chart illustrating one example of the process for outputting the second information (S114) according to Variation 5.

First information processing apparatus 100 sets the priority level of each of a plurality of second information processing apparatuses 200 (S1141). In other words, first information processing apparatus 100 sets the priority level for each of a plurality of second information processing apparatuses 200 that correspond to a plurality of first requests having the same request content. For example, the priority levels may be included in the first request information, and in such cases, the priority levels are set according to the priority levels included in the first request information. The priority levels may be set according to the situation of space 20 or the user that is obtained from sensor group 300 and device group 400. Moreover, the priority levels of the plurality of second information processing apparatuses 200 may be set based on bid amounts by the service providers for the provision of the second information.

Next, first information processing apparatus 100 selects one or more second information processing apparatuses 200 based on the set priority level (S1142). For example, first information processing apparatus 100 selects, from among a plurality of second information processing apparatuses 200 that correspond to a plurality of first requests having the same request content, the second information processing apparatus 200 having the highest priority level. Note that the number of second information processing apparatuses 200 selected is not limited to one.

First information processing apparatus 100 then outputs the second information to the selected second information processing apparatus 200 (S1143). Thereafter, first information processing apparatus 100 determines whether the service has been provided by the selected second information processing apparatus 200 within a given period (S1144). In other words, whether or not the selected second information processing apparatus 200 has provided the service within a given period starting when the second information is output is determined. An empirically or experimentally predefined period can be used as the given period. For example, the same period may be used across a plurality of services. Alternatively, individually set times for the plurality of services may be used as the given period.

When the service is provided within the given period (Yes in S1144), processing ends. However, when the service is not provided within the given period (No in S1144), processing proceeds to step S1141. This time in step S1141, the priority levels of the plurality of second information processing apparatuses 200 are updated such that the priority level of the second information processing apparatus 200 that did not provide the service is reduced. First information processing apparatus 100 then selects one or more second information processing apparatuses 200 based on the updated priority levels (S1142). Here, the system may be configured so that the service can only be provided to the user or space 20 when the priority level is set to the highest level. For example, if the second information is sent to both the second information processing apparatus 200 set to the highest priority level before the update and the second information processing apparatus 200 set to the highest priority level after the update, there is a chance that the service may be redundantly provided when, after a given period, the service is attempted to be provided by the second information processing apparatus 200 set to the highest priority level before the update. Accordingly, the system may be set so that only the second information processing apparatus 200 set to the highest priority level can use the second information. For example, this may be achieved by setting the system so that the second information may only be used at the time the service is executed, so that the encryption is changed after each update, and providing an encryption key corresponding to the second information processing apparatus 200 set to the highest priority level.

Advantageous Effects, etc.

As described above, according to the present variation, first information processing apparatus 100 can select a second information processing apparatus 200 based on priority level. Accordingly, service providing systems 10 and 10A can select a second information processing apparatus 200 that is appropriate for the provision of the service from among a plurality of second information processing apparatuses 200 corresponding to a plurality of first requests having the same request content.

Types of Services

Next, the types of services in the service providing system according to the above embodiments will be described.

Overview of Provided Services

FIG. 26A illustrates an overview of the service providing system.

Group 1000 is, for example, a business, an organization, or a household or the like. The scale of group 1000 may be any scale. Group 1000 includes devices A and B included in plural devices 1010, and home gateway 1020. For example, plural devices 1010 are devices included in device group 400 according to the above embodiments. For example, home gateway 1020 is gateway 500 according to the above embodiments. Plural devices 1010 include devices that can connect to the internet (for example, smartphones, PCs, televisions, etc.) as well as devices that cannot connect to the internet themselves (for example, lights, washing machines, etc.). Even devices that cannot connect to the internet themselves but can connect to the internet via home gateway 1020 may be included. Moreover, user(s) 990A that use plural devices 1010 are in group 1000.

Data center operating company 1100 includes cloud server 1110. Cloud server 1110 is a virtual server that links with various devices over the internet. For example, cloud server 1110 is first information processing apparatus 100 according to the above embodiments. For example, cloud server 1110 manages big data which is difficult to manage with typical database management tools. Data center operating company 1100 performs operations of a data center, such as data management and management of cloud server 1110. Services performed by data center operating company 1100 will be described in greater detail later. Here, data center operating company 1100 is not limited to a company that only performs operations such as data management and operation of cloud server 1110. For example, when a device manufacturer that develops and produces one device among plural devices 1010 also performs data management and management of cloud server 1110, that device manufacturer corresponds to data center operating company 1600 (FIG. 26B). Moreover, data center operating company 1100 is not limited to a single company. For example, when a device manufacturer and another management company work in consort or through shared contribution to carry out the data management and operation of cloud server 1110, both or one of the device manufacturer and the management company corresponds to data center operating company 1100 (FIG. 26C).

Service provider 1200 has server 1210. As used herein, the scale of server 1210 may be any scale. For example, server 1210 may be memory included in a personal computer. Moreover, there are cases in which service provider 1200 does not have server 1210. For example, server 1210 is second information processing apparatus 200 according to the above embodiments.

Note that home gateway 1020 is not required in the service described above. For example, when cloud server 1110 does all of the data management, home gateway 1020 is not necessary. Furthermore, there are cases in which there are no devices that cannot connect to the internet themselves, such as when all household devices are connected to the internet.

Next, the flow of information in the above service will be described.

First, device A and device B in group 1000 transmit information they obtained to cloud server 1110 in data center operating company 1100. Cloud server 1110 accumulates the information from device A or device B ((a) in FIG. 26A). The accumulated information is information indicating, for example, the operation status, operating date and time, operation mode, position, etc., of plural devices 1010. Examples include, but are not limited to, television viewing history, television video recorder scheduled recordings, washing machine operating date and time, washing machine laundry amount, date and time that the door of a refrigerator opened or closed, number of times that the door of a refrigerator opened or closed, and amount of food in a refrigerator; the accumulated information includes any information that can be obtained from any kind of device. There are cases in which the information is provided directly to cloud server 1110 from plural devices 1010 themselves via the internet. The information may be obtained from plural devices 1010 and intermediately accumulated by home gateway 1020, from where it is provided to cloud server 1110.

Next, cloud server 1110 in data center operating company 1100 provides the accumulated information to service provider 1200 in fixed units. Here, fixed units may be units in which the data center operating company can organize the collected information and provide the collected information to service provider 1200, and may be units requested by service provider 1200. Although the term “fixed units” is used herein, the units need not be fixed; the amount of information provided may be variable according to the situation. The information is stored in server 1210 of service provider 1200 ((b) in FIG. 26A). Service provider 1200 then organizes the information to suit the service to be provided to the user, and then provides it to the user. The user on the receiving end may be user 990A that uses plural devices 1010, and may be external user(s) 990B. The method of providing the service to the user may be a method whereby the service is provided directly from the service provider, for example ((e), (f) in FIG. 26A). Alternatively, the method of providing the service to the user may be a method whereby the service is provided to the user via cloud server 1110 in data center operating company 1100 ((c), (d) in FIG. 26A). Moreover, cloud server 1110 in data center operating company 1100 may organize the information to suit the service to be provided to the user, and then provide the information to service provider 1200.

Note that user 990A and user 990B may be the same or different users.

For example, the techniques described above can be realized in the following types of cloud services. However, the techniques described above are not limited to being realized in the following examples.

Service Type 1: In-Company Data Center

FIG. 27 illustrates service type 1 (in-company data center). In this type, service provider 1200 obtains information from group 1000 and provides a service to a user. In this type, service provider 1200 functions as a data center operating company. In other words, the service provider has cloud server 1110 that manages big data. Accordingly, there is no data center operating company.

In this type, service provider 1200 operates and manages data center 903 (cloud server 1110). Service provider 1200 also manages OS 902 and application 901. Service provider 1200 provides service 904 using OS 902 and application 901 that it manages.

Service Type 2: IaaS

FIG. 28 illustrates service type 2 (IaaS). As used herein, “IaaS” stands for infrastructure as a service, and refers to a cloud service provision model that provides an infrastructure for constructing and operating a computer system, as a service via the internet.

In this type, data center operating company 1100 operates and manages data center 903 (cloud server 1110). Service provider 1200 also manages OS 902 and application 901. Service provider 1200 provides service 904 using OS 902 and application 901 that it manages.

Service Type 3: PaaS

FIG. 29 illustrates service type 3 (PaaS). As used herein, “PaaS” stands for platform as a service, and refers to a cloud service provision model that provides a platform for constructing and operating software, as a service via the internet.

In this type, data center operating company 1100 manages OS 902 and operates and manages data center 903 (cloud server 1110). Service provider 1200 also manages application 901. Service provider 1200 provides service 904 using OS 902 managed by the data center operating company and application 901 that itself manages.

Service Type 4: SaaS

FIG. 30 illustrates service type 4 (SaaS). As used herein, “SaaS” stands for software as a service. For example, SaaS refers to a cloud service provision model that, for example, has a function that allows a company or individual (user) that does not have a data center (cloud server) to use, over a network such as the internet, an application provided by a platform provider that has a data center (cloud server).

In this type, data center operating company 1100 manages application 901, manages OS 902, and operates and manages data center 903 (cloud server 1110). Service provider 1200 provides service 904 using OS 902 and application 901 that data center operating company 1100 manages.

In any of the above types, the service provision is performed by service provider 1200. Moreover, for example, the service provider or the data center operating company may develop, for example, the OS, application, or database of big data themselves, or may outsource the OS, application, or database of big data from a third party.

Other Embodiments

Although the service providing system according to one or more aspects of the present disclosure has been described based on embodiments, the present disclosure is not limited to these embodiments. Those skilled in the art will readily appreciate that various modifications may be made in these exemplary embodiments and that other embodiments may be obtained by arbitrarily combining the elements of the embodiments without materially departing from the novel teachings and advantages of the subject matter of the present disclosure. Accordingly, all such modifications and other embodiments are included in one or more aspects of the present disclosure.

For example, in the embodiments above, first information processing apparatus 100 that processes the sensor data and second information processing apparatus 200 that generates the service information are provided as separate apparatuses, but first information processing apparatus 100 and second information processing apparatus 200 may be configured as a single information processing apparatus. In such cases, since there is no need for interaction between first information processing apparatus 100 and second information processing apparatus 200, when the first condition is satisfied, processes from the generation of the first information to the output of the second information may be skipped.

INDUSTRIAL APPLICABILITY

The techniques of the present disclosure can be used as an information processing apparatus that provides information for providing a service to a user. 

1. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a sensor is disposed in a space, and the processor: obtains, via the sensor, a current behavior of a user; obtains, from the memory, information indicating a predefined behavior predefined as a relaxation behavior; obtains, from the memory, information on communication content of a communication tool; obtains, from the memory, information indicating a shopping history of the user; when (i) the current behavior of the user includes the predefined behavior and (ii) first content included in the information on the communication content and second content included in the information indicating the shopping history are a same content, generates first information indicating that the user who is interested in the first content is relaxing; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.
 2. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a first sensor and a second sensor are disposed in a space, the second sensor being a temperature sensor, and the processor: obtains, via the second sensor, a current temperature of the space; obtains, from the memory, a past statistical temperature of the space; obtains, via the first sensor, a current activity of a user; when (iii) the current temperature is lower than the past statistical temperature by a threshold temperature or more and (iv) the current activity of the user includes a predefined activity predefined as an activity of looking for clothes, generates first information indicating that the user feels cold; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.
 3. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a first sensor and a second sensor are disposed in a space, the second sensor being a temperature sensor, and the processor: obtains, from the memory, a past ventilation history of the space based on sensor data from the second sensor; obtains weather information corresponding to a location of the space; obtains, from the memory, predefined weather predefined as weather suitable for ventilation; obtains, via the first sensor, air information indicating a pollution level of air in the space; when (v) a given amount of time or more has elapsed from a most recent date and time included in the past ventilation history of the space to a current date and time, (vi) the weather information indicates the predefined weather, and (vii) the pollution level of the air in the space is a given pollution level or higher, generates first information indicating that conditions are suitable for ventilating the space; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying a user or the space, using the first information generated.
 4. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein an object and a sensor are disposed in a space, and the processor: obtains, via the sensor, a degree of dirtiness of the object; obtains, from the memory, a past maintenance history of the object; when (viii) the degree of dirtiness of the object obtained is greater than a given degree of dirtiness and (ix) a given amount of time or more has elapsed from a most recent maintenance date and time included in the past maintenance history of the object to a current date and time, generates first information indicating that a time to perform maintenance of the object is approaching; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying a user or the space, using the first information generated.
 5. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a first sensor and a first electronic device are disposed in a kitchen space of a home, a second sensor and a second electronic device are disposed in a dining space of the home, and the processor: obtains, via the first sensor, current sensing information corresponding to the kitchen space; obtains, from the memory, past sensing statistical information corresponding to the dining space; when (x) the current sensing information includes information indicating at least one of a user being present in the kitchen space or the first electronic device in the kitchen space being active and (xi) an amount of time from a current time to a statistical time included in the past sensing statistical information is a given amount of time or less, generates first information indicating that a mealtime will soon begin in the dining space, the statistical time indicating at least one of the user being present in the dining space or the second electronic device in the dining space being active; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.
 6. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a washing machine and a sensor are disposed in a space, and the processor: when (xii) a type of a stain on laundry to be washed in the washing machine is obtained by the sensor and (xiii) a washing mode suitable for the type of the stain on the laundry is selected from among washing modes of the washing machine, generates first information indicating that a user is about to wash the laundry using the washing machine; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.
 7. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a sensor and a cooking appliance are disposed in a space, and the processor: obtains, via the sensor, current activity information of a user in the space; obtains current user-operation information of the cooking appliance; when (xiv) the activity information includes an activity of the user holding a given food or drink in hand and (xv) the current user-operation information includes a predefined user operation predefined as operation of the cooking appliance by the user for starting preparation of the given food or drink, generates first information indicating that the user is about to start preparing the given food or drink using the cooking appliance; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated.
 8. An information providing method that uses a first information processing apparatus which includes a processor and memory, wherein a sensor and an electronic device that outputs at least one of sound or video are disposed in a space, and the processor: obtains device activity information of the electronic device; obtains, via the sensor, activity information of a user; when (xvi) the device activity information indicates that the electronic device is active and (xvii) the activity information indicates that the user is moving from the space to another space, generates first information indicating that the user is moving from the space to the another space while the electronic device is active; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the space, using the first information generated. 